Tesla will now alert you when vision-monitoring isn't being used
@WifeDirtyTesla
With FSD V12.4.1 finally beginning its rollout to select customers as of last night. You’re probably wondering exactly how nags will – or won’t – work for the updated and much-hyped update.
No Steering Wheel Nags
Tesla’s current implementation of no steering wheel nags on V12.4.1 is pretty simple and straightforward. As long as you’re paying attention and looking at the road, you won’t be required to touch the steering wheel. You’ll see a green dot on the screen, letting you know that the enhanced driver monitoring system (DMS) and Vision-Based Attention Monitoring (VBAM) are active.
On the Model S and X, the green dot is on the instrument cluster screen, immediately next to the blue FSD/AP wheel icon. On the Model 3 and Model Y (and Cybertruck, in the future), the green dot indicator is on the top left of the screen, in between the battery indicator and the blue FSD/AP wheel.
However, there are some restrictions baked into this initial implementation. Your eyes cannot be obscured or occluded from the cabin camera. This means that legacy vehicles are ineligible for the new VBAM, along with anyone who installs a physical camera cover for privacy or other reasons.
For the privacy-conscious folks, Tesla has mentioned that cabin camera imagery will not leave the vehicle itself unless you enable data sharing, which is optional. Cabin camera imagery is also not available to view via the API, so third-party integrations cannot view your cabin camera either.
The green dot on the center display
Whole Mars Catalog
Restrictions
There are some other catches too. The cabin camera is currently unable to see through sunglasses due to the polarization. The car will display “Attention monitoring unavailable, sunglasses use detected” on the screen. This could change in the future as Tesla figures out how to best take advantage of its cabin cameras. However, it can see through regular glasses just fine – so eyeglass wearers, rejoice!
Attention monitoring unavailable, sunglasses use detected
Vehicles that do not have IR lights in the cabin will also not be able to take advantage of VBAM at night – as the cameras in vehicles without IR lights are unable to see at night. Tesla does offer a refit for vehicles to upgrade to IR-capable cameras – put in a service ticket if you’re interested through the Service Menu on the app.
If it cannot find your eyes due to any of these restrictions, the green light will not come on, and the regular wheel nags that you are used to will continue.
Warnings and Suspensions
If VBAM determines that you’re not paying attention – initially a screen warning will appear, telling you to pay attention to the road. This can be dismissed quickly by just reverting your attention to the road ahead of you. You won’t have to touch the steering wheel to dismiss the nag.
However, if you continue to not pay attention and the DMS detects improper usage, you will receive an Autopilot Strikeout, and FSD will disengage. Before a Strikeout occurs, there will be multiple auditory and visual warnings, ensuring you have a few moments to bring your attention back to supervising FSD.
You can receive up to 5 Strikeouts before the FSD becomes suspended. One strikeout will be lifted per 7-day period in which you do not receive a Strikeout. If you hit 5 Strikeouts, it could be up to 5 weeks before you clear all of them! If you receive another Strikeout within that 7-day period after an initial Strikeout, the 7-day period is reset.
Other Changes
Elon Musk has mentioned that V12.4 was supposed to be focused on user comfort, by reducing hard acceleration and braking. According to Musk, it should have a 5-10x improvement between user disengagements.
Early Access owners have mentioned that 12.4 tends to be more assertive and less hesitant when it comes to intersections, stop signs, and parking lots. Owners have also noticed improvements in the “lane dancing”, where FSD V12.3 would stray in between lanes for too long while changing lanes.
Of additional note is that Vision Autopark is slightly faster – but this is the same Vision Autopark speed increase that rolled out to customers who have already received the Spring Update. For everyone else, expect a 2-3x improvement in how fast Vision Autopark changes directions, and how fast it maneuvers in general. As of the Spring Update, it can now park in even tighter spaces.
Sadly, some previously announced features were missed out on in this release of FSD V12.4.1. Namely, the key features of Banish Autopark and Park Seek. For the time being, users will still have to disengage FSD and then engage Autopark once they find their parking spot.
Banish Autopark, or “Reverse Summon” was thought to arrive in V12.4 as part of the comfort update according, allowing you to choose a parking spot type preference, exit the vehicle, and then have the car park itself.
Additionally, Park Seek – which would allow FSD to automatically find a parking spot in a parking lot, and then engage Autopark automatically, was initially a confirmed feature, but is not present in this release.
Finally, Hand Gesture recognition was supposed to come in an update “later in May” – but given that FSD V12.4 has missed previous deadlines – no surprise to people familiar with the “2 week policy” – there is no confirmation yet if that feature has made it into this build. It is very possible that the employee in question may have been referring to V12.5 – which is also expected to bring vehicle-to-fleet communication.
Given that it just rolled out to employees yesterday, and then to “OG” FSD Beta owners today, we could expect 2024.15.5 – the version that contains V12.4.1 – to hopefully continue rolling out to customers next week. Everyone with an update under 2024.15.5 - so users on 2024.3.25, 2024.8.9, and 2024.14.11 – should be eligible to receive this update. The very few vehicles already on 2024.20 with the Adaptive Headlights functionality will have to wait a bit longer!
Subscribe
Subscribe to our newsletter to stay up to date on the latest Tesla news, upcoming features and software updates.
Tesla appears to be preparing to expand its Robotaxi geofence in Austin, Texas, with numerous engineering vehicles taking to the road. One of the most interesting sights, between the short and tall LiDAR rigs, was a Cybertruck validation vehicle, which we don’t often see.
Tesla’s expansion is moving the Robotaxi Network into downtown Austin, a dense urban environment that is currently outside the geofence. It appears Tesla is content with the latest builds of Robotaxi FSD and is ready to take on urban traffic.
The inclusion of a Cybertruck in the validation fleet is noteworthy, as the rest of the vehicles are Model Ys. This suggests that Tesla may be addressing two challenges simultaneously: expanding its service area while also addressing the FSD gap between the Cybertruck and other HW4 Tesla vehicles.
Tesla Validating Downtown Austin before expanding the Robotaxi geo-fence area. pic.twitter.com/ylFATtjcDi
Recent sightings have shown a fleet of Tesla vehicles, equipped with rooftop validation sensor rigs, running routes throughout downtown Austin and across the South Congress Bridge. While these rigs include LiDAR, it’s not a sign that Tesla is abandoning its vision-only approach.
Instead, Tesla uses the high-fidelity data from the LiDAR as a ground truth measurement to validate and improve the performance of its cameras. In short, it essentially uses the LiDAR measurements as the actual distances and then compares the distances determined in vision-only to the LiDAR measurements. This allows Tesla to tweak and improve its vision system without needing LiDAR.
This data collection in a new, complex environment right outside the Robotaxi geofence is an indicator that plans to expand the geofence. Tesla has previously indicated that they intend to roll out more vehicles and expand the geofence slowly. Given that their operational envelope includes the entire Austin Metro Area, we can expect more locations to open up gradually.
Once they expand the operational radius to include downtown Austin, they will likely also have to considerably increase the number of Robotaxis active in the fleet at any given time. Early-access riders are already saying that the wait time for a Robotaxi is too long, with them sometimes having to wait 15 minutes to be picked up.
With a larger service area, we expect Tesla to also increase the number of vehicles and the number of invited riders to try out the service.
After all, Tesla’s goal is to expand the Robotaxi Network to multiple cities within the United States by the end of 2025. Tesla has already been running an employees-only program in California, and we’ve seen validation vehicles as far away as Boston and New Jersey, on the other side of the country.
Cyber FSD Lagging Behind
One of the most significant details from these recent sightings is the presence of a Cybertruck. Cybertruck’s FSD builds have famously lagged behind the builds available on the rest of Tesla’s HW4 fleet. Key features that were expected never fully materialized for the Cybertruck, and the list of missing features is quite extensive.
Start FSD from Park
Improved Controller
Reverse on FSD
Actually Smart Summon
It may not look like a lot, but if you drive a Cybertruck on FSD and then hop in any of the rest of Tesla’s HW4 vehicles, you’ll notice a distinct difference. This is especially evident on highways, where the Cybertruck tends to drift out of the lane, often crossing over the lane markings.
Tesla was testing parts of Downtown Austin, TX with this Cybertruck which had a massive roof rack, and sensors.
We previously released an exclusive mentioning that a well-positioned internal source confirmed with us that a new FSD build for the Cybertruck was upcoming, but we never ended up receiving that particular build, only a point release to V13.2.9. The AI team’s focus had clearly shifted to getting the latest Robotaxi builds running and validated, and while a flagship, the Cybertruck fleet was small and new, and really a secondary task.
The Cybertruck’s larger size, steer-by-wire, rear-wheel steering, and different camera placements likely present a bigger set of challenges for FSD. Deploying it now as a validation vehicle in a complex environment like downtown Austin suggests that Tesla is finally gathering the specific data needed to bring the Cybertruck’s capabilities up to par. This focused effort is likely the necessary step to refine FSD’s handling of the Cybertruck before they begin rolling out new public builds.
When?
Once Tesla’s validation is complete, we can probably expect the Robotaxi Network to expand its borders for the first time in the coming days or weeks. However, we’ll likely see more signs of the expansion, such as Robotaxi vehicles driving themselves around the area, before the expansion actually happens.
Hopefully, the Cybertruck will also learn from its older siblings and receive the rest of its much-needed FSD features, alongside an FSD update for the entire fleet.
Tesla is rolling out a fairly big update for its iOS and early-access-only Robotaxi app, delivering a suite of improvements that address user feedback from the initial launch last month. The update improves the user experience with increased flexibility, more information, and overall design polish.
The most prominent feature in this update is that Tesla now allows you to adjust your pickup location. Once a Robotaxi arrives at your pickup location, you have 15 minutes to start the ride. The app will now display the remaining time your Robotaxi will wait for you, counting down from 15:00. The wait time is also shown in the iOS Live Activity if your phone is on the lock screen.
How Adjustable Pickups Work
We previously speculated that Tesla had predetermined pickup locations, as the pickup location wasn’t always where the user was. Now, with the ability to adjust the pickup location, we can clearly see that Tesla has specific locations where users can be picked up.
Rather than allowing users to drop a pin anywhere on the map, the new feature works by having the user drag the map to their desired area. The app then presents a list of nearby, predetermined locations to choose from. Once a user selects a spot from this curated list, they hit “Confirm.” The pickup site can also be changed while the vehicle is en route.
This specific implementation raises an interesting question: Why limit users to predetermined spots? The answer likely lies in how Tesla utilizes fleet data to improve its service.
Here is the new Tesla Robotaxi pickup location adjustment feature.
While the app is still only available on iOS through Apple’s TestFlight program, invited users can download and update the app.
Tesla included these release notes in update 25.7.0 of the Robotaxi app:
You can now adjust pickup location
Display the remaining wait time at pickup in the app and Live Activity
Design improvements
Bug fixes and stability improvements
Nic Cruz Patane
Why Predetermined Pick Up Spots?
The use of predetermined pickup points is less of a limitation and more of a feature. These curated locations are almost certainly spots that Tesla’s fleet data has identified as optimal and safe for an autonomous vehicle to perform a pickup or drop-off.
This suggests that Tesla is methodically “mapping” its service area not just for calibration and validation of FSD builds but also to help perform the first and last 50-foot interactions that are critical to a safe and smooth ride-hailing experience.
An optimal pickup point likely has several key characteristics identified by the fleet, including:
A safe and clear pull-away area away from traffic
Good visibility for cameras, free of obstructions
Easy entry and exit paths for an autonomous vehicle
This change to pick-up locations reveals how Tesla’s Robotaxi Network is more than just Unsupervised FSD. There are a lot of moving parts, many of which Tesla recently implemented, and others that likely still need to be implemented, such as automated charging.
Frequent Updates
This latest update delivers a much-needed feature for adjusting pickup locations, but it also gives us a view into exactly what Tesla is doing with all the data it is collecting with its validation vehicles rolling around Austin, alongside its Robotaxi fleet.
Tesla is quickly iterating on its app and presumably the vehicle’s software to build a reliable and predictable network, using data to perfect every aspect of the experience, from the moment you hail the ride to the moment you step out of the car.
![Tesla Updates Robotaxi App: Adds Adjustable Pick Up Locations, Shows Wait Time and More [VIDEO]](https://www.notateslaapp.com/img/containers/article_images/tesla-app/robotaxi-app/25-7-0/robotaxi-app-25.7.0.webp/4ac9ed40be870cfcf6e851fce21c43b9/robotaxi-app-25.7.0.jpg)
